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Epitome 

(57) [Abstract] (*****+) 

[Technical problem] The three-dimension location metering device by the stereo method in 
which easy highly precise and three-dimension location measurement is possible, and its 
measurement approach are offered. 

[Means for Solution] The image data picturized with two or more image pick-up equipments is 
inputted, and it is the image processing of this image data. The coordinate value of two or more 
points corresponding to each pattern in the monitor system of coordinates in image pick-up 
equipment is computed. It asks for the curved-surface polynomial which approximates each 
curved surface formed by two or more [ in the monitor system of coordinates corresponding to 
the plate in a location ] based on said computed coordinate value, each — alienation — Each 
multiplier of the curved-surface polynomial corresponding to a location is memorized, each 
alienation — at the time of actual location measurement The coordinate value in the monitor 
system of coordinates of point of measurement 7 is computed, and based on the physical 
relationship of this coordinate value and the curved surface of the both sides which faced across 
the point of measurement 7 in monitor system of coordinates among two or more curved 
surfaces depended on each multiplier by which storage was carried out [ above-mentioned ], the 
world coordinate location of point of measurement 7 is computed with interpolation, and it 
measures. 
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1. This document has been translated by computer. So the translation may not reflect the original 
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CLAIMS 



[Claim(s)] 

[Claim 1] Two or more image pick-up equipments which installed the optical axis of a lens in the 
mutually different direction (1 2) It has. They are two or more of these image pick-up 
equipments (1 2) about the measuring object object installed in the world coordinate. The image 
processing of the picturized image data is carried out and it is point of measurement (7). It asks 
for the location in the monitor system of coordinates in image pick-up equipment It is based on 
this monitor coordinate location, and is point of measurement (7). In the three-dimension 
location metering device by the stereo method which measures the location in a world 
coordinate Calibration plate with which two or more patterns (9a) were beforehand drawn on the 
predetermined location in a world coordinate (9) Predetermined distance every When installed in 
two or more estranged locations, this calibration plate (9) each — alienation — every location — 
said two or more image pick-up equipments (1 2) Calibration plate (9) The picturized image data 
is inputted. This coordinate value of two or more points in monitor system of coordinates is 
computed from the location of two or more points corresponding to each above-mentioned 
pattern on this image (9a). said — each — alienation — calibration plate (9) in a location It asks 
for the curved-surface polynomial which approximates the curved surface (1 1) formed of two or 
more points in corresponding monitor system of coordinates describing above based on said 
computed coordinate value. Each multiplier of the curved-surface polynomial corresponding to a 
location is memorized, each — alienation — after this at the time of location measurement of an 
actual measuring object object Point of measurement on an image (7) Point of measurement in 
[ a location to ] monitor system of coordinates (7) A coordinate value is computed. This 
computed coordinate value, It is the point of measurement in monitor system of coordinates (7) 
among two or more curved surfaces (1 1) depended on each multiplier of two or more curved- 
surface polynomials by which storage was carried out [ above-mentioned ]. It is based on 
physical relationship with the curved surface (1 1) of the inserted both sides. It is point of 
measurement (7) by interpolation. Image processing system which computes and measures the 
location of a world coordinate (5) Three-dimension location metering device by the stereo 
method characterized by having. 

[Claim 2] The curved-surface polynomial which approximates said curved surface (11) in the 
three-dimension location metering device by the stereo method according to claim 1 is a three- 
dimension location metering device by the stereo method characterized by being a smooth 
three-dimension polynomial. 

[Claim 3] It sets to the three-dimension location metering device by the stereo method 
according to claim 1, and they are said two or more image pick-up equipments (1 2). Inside, At 
least it is the 1st image pick-up equipment (1). One axis of coordinates of a world coordinate is 
set as a lens optical axis at parallel, and 2nd image pick-up equipment (2) a lens optical axis is 
inclined to a top Norikazu axis of coordinates — making — said image processing system (5) 
Image pick-up equipment of the above 1st (1) Based on image data, the coordinate value by the 
axis of coordinates of the monitor system of coordinates which intersect perpendicularly with 
the one above-mentioned axis of coordinates is computed. And image pick-up equipment of the 
above 2nd (2) Three-dimension location metering device by the stereo method characterized by 
computing the coordinate value by the axis of coordinates of monitor system of coordinates 
parallel to the one above-mentioned axis of coordinates based on image data. 
[Claim 4] Said calibration plate installed in said two or more locations in the three-dimension 
location metering device by the stereo method according to claim 1 (9) Three-dimension location 
metering device by the stereo method characterized by intersecting perpendicularly with one 
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axis of coordinates of a world coordinate. 

[Claim 5] In the three-dimension location metering device by the stereo method according to 
claim 2 or 3 Said image processing system (5) It is based on each curved-surface polynomial in 
the monitor system of coordinates approximated corresponding to said two or more curved 
surfaces (1 1). and is the point of measurement (7) of said measuring object object. When 
computing the location of a world coordinate, each above-mentioned curved-surface polynomial, 
The three-dimension location metering device by the stereo method characterized by 
interpolating and computing the point of measurement in monitor system of coordinates (7) 
based on a straight-line type parallel to a passage and one axis of coordinates in monitor system 
of coordinates. 

[Claim 6] It sets to the three-dimension location metering device by the stereo method 
according to claim 1 to 5, and they are said two or more image pick— up equipments (1 2). It is a 
three-dimension location metering device by the stereo method characterized by inside and at 
least one set being slanting CCD camera equipment. 

[Claim 7] two or more image pick-up equipments (1 2) which installed the optical axis of a lens in 
the mutually different direction The measuring object object installed in the world coordinate is 
picturized. the image processing of this picturized image data is carried out, and it is point of 
measurement (7). It asks for the location in the monitor system of coordinates in image pick-up 
equipment. It is based on this monitor coordinate location, and is point of measurement (7). In 
the three— dimension location measurement approach by the stereo method which measures the 
location in a world coordinate Calibration plate with which two or more patterns (9a) were 
beforehand drawn on the predetermined location in a world coordinate (9) Predetermined 
distance every When installed in two or more estranged locations, this calibration plate (9) each 
— alienation — every location — said two or more image pick-up equipments (1 2) Calibration 
plate (9) The picturized image data is inputted. This coordinate value of two or more points in 
monitor system of coordinates is computed from the location of two or more points 
corresponding to each above-mentioned pattern on this image (9a). said — each — alienation — 
calibration plate (9) in a location It asks for the curved-surface polynomial which approximates 
the curved surface (11) formed of two or more points in corresponding monitor system of 
coordinates describing above based on said computed coordinate value. Each multiplier of the 
curved-surface polynomial corresponding to a location is memorized, each — alienation — after 
this at the time of location measurement of an actual measuring object object Point of 
measurement on an image (7) Point of measurement in [ a location to ] monitor system of 
coordinates (7) A coordinate value is computed. This computed coordinate value. It is the point 
of measurement in monitor system of coordinates (7) among two or more curved surfaces (11) 
depended on each multiplier of two or more curved— surface polynomials by which storage was 
carried out [ above-mentioned ]. It is based on physical relationship with the curved surface (11) 
of the inserted both sides. It is point of measurement (7) by interpolation. The three— dimension 
location measurement approach by the stereo method characterized by computing and 
measuring the location of a world coordinate. 

[Claim 8] The curved-surface polynomial which approximates said curved surface (11) in the 
three-dimension location measurement approach by the stereo method according to claim 7 is 
the three-dimension location measurement approach by the stereo method characterized by 
being a smooth three-dimension polynomial. 

[Claim 9] It sets to the three-dimension location measurement approach by the stereo method 
according to claim 7, and they are said two or more image pick-up equipments (1 2). Inside, At 
least, it is the 1st image pick-up equipment (1). One axis of coordinates of a world coordinate is 
set as a lens optical axis at parallel, and it is the 2nd image pick-up equipment (2). While making 
a lens optical axis incline to a top Norikazu axis of coordinates Image pick-up equipment of the 
above 1st (1) Based on image data, the coordinate value by the axis of coordinates of the 
monitor system of coordinates which intersect perpendicularly with the one above-mentioned 
axis of coordinates is computed. And image pick-up equipment of the above 2nd (2) The three- 
dimension location measurement approach by the stereo method characterized by computing the 
coordinate value by the axis of coordinates of monitor system of coordinates parallel to the one 
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above-mentioned axis of coordinates based on image data. 

[Claim 10] It sets to the three-dimension location measurement approach by the stereo method 
according to claim 7, and is said calibration plate (9). It is the three-dimension location 
measurement approach by the stereo method characterized by making it intersect 
perpendicularly with one axis of coordinates of a world coordinate, and installing when installing 
in two or more locations. 

[Claim 1 1] In the three— dimension location measurement approach by the stereo method 
according to claim 8 or 9 It is based on each curved-surface polynomial in the monitor system of 
coordinates approximated corresponding to said two or more curved surfaces (1 1), and is the 
point of measurement (7) of said measuring object object. When computing the location of a 
world coordinate Each above-mentioned curved-surface polynomial and point of measurement in 
monitor system of coordinates (7) A passage and the three-dimension location measurement 
approach by the stereo method characterized by interpolating and computing based on a 
straight-line type parallel to one axis of coordinates in monitor system of coordinates. 



[Translation done,] 
* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the location count approach of the three- 
dimension metering device by the stereo method. 
[0002] 

[Description of the Prior Art] In the so-called three-dimension metering device which measures 
an objective three-dimension-location, many stereo methods are adopted from the former. The 
location measurement by this stereo method is picturized from the direction which changes a 
measurement object with two or more image pick-up equipments, and asks for the position- 
coordinate data of a three dimension based on these image pick-up data. 

[0003] Based on the include angle which the physical relationship about two or more above- 
mentioned image pick-up equipments, for example, a mutual lens optical axis, accomplishes as 
one of the measurement approaches by the stereo method, there is a method of asking for the 
location of an object from the location data on an image pick-up screen, for example, to JP f 62- 
162912.A Two image pick-up equipments are arranged so that the optical axis of a lens may 
cross at the predetermined include angle theta on datum level. Picturize the measurement object 
installed on datum level with these two image pick-up equipments, and the variation rate of the 
predetermined point P of a measurement object is got to know from the image pick-up result of 
the 2nd image pick-up equipment on the basis of the image pick-up result of the 1st image pick- 
up equipment. The height measuring device which can ask for said elevation of the 
predetermined point P describing above based on this variation rate is indicated. That is, the 
predetermined point P is a location X1 on the image of the 1st image pick-up equipment It is 
picturized and the predetermined point P is a location X2 on the image of the 2nd image pick-up 
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equipment. Supposing it is picturized, height H of the predetermined point P will be called for 
with a formula "H=(X2-X1)/sin theta/' 

[0004] Moreover, there is a method of computing and asking for the measuring point of an object 
as other measurement approaches by the stereo method from the predetermined relation 
between the coordinate (it being called monitor coordinate) location on the picturized image and 
a coordinate (it being called world coordinate) location measuring to the actual condition of a 
measuring object object. This asks for correspondence with the coordinate of two or more 
specifying points with the clear location in a world coordinate, and the coordinate on the monitor 
coordinate of the point which picturized two or more of these specifying points beforehand, and 
computes the coordinate on the world coordinate of the above-mentioned measure point from 
the physical relationship of the actual monitor coordinate value of the measure point of a 
measuring object object, and the monitor coordinate value of the point corresponding to each 
above-mentioned specifying point, therefore, the accuracy of the computed coordinate the 
account of a top — it will be influenced by the fineness of the numerousness of the number of 
specifying points made to correspond beforehand, i.e., spacing of specifying points. 
[0005] 

[Problem(s) to be Solved by the Invention] In the location (height) measuring method by the 
stereo method indicated by said JP,62-1 6291 2 A in order to search for the position coordinate 
of a three dimension correctly, it is necessary to search for correctly the physical relationship 
about said two or more image pick-up equipments beforehand. Conversely, when it says, the 
accuracy of this physical relationship will influence greatly the precision of the location 
measurement result by the stereo method. Usually, this physical relationship is computed by a 
design value and the measurement value, or is computed by the calibration. However, since 
precision is required, the calibration approach and measuring method which search for the 
physical relationship in the world coordinate of this image pick-up equipment are very difficult. 
Consequently, there is a problem that accurate physical relationship is hard to be acquired, bad 
[ workability, such as this calibration, ]. 

[0006] Moreover, since the accuracy of the coordinate which computed correspondence with the 
coordinate of the specifying point in the above world coordinates and the coordinate on the 
monitor coordinate of the point which picturized this specifying point by this approach in the 
approach of searching for beforehand is influenced by the fineness of spacing of the above- 
mentioned specifying points, the information about very many specifying points is needed. 
Therefore, in order to memorize great amount of information, while a very mass memory 
apparatus will be needed and a cost rise will be caused, when actually performing location 
measurement, the problem that the computation time of computers, such as an image 
processing, starts too much is also produced. 

[0007] This invention is made paying attention to the above-mentioned trouble, and aims at 
offering the three-dimension location metering device by the stereo method in which easy highly 
precise and three-dimension location measurement is possible, and its measurement approach. 
[0008] 

[Means for Solving the Problem and its Function and Effect] In order to attain the above- 
mentioned purpose, invention according to claim 1 It has two or more image pick-up equipments 
1 and 2 which installed the optical axis of a lens in the mutually different direction. Carry out the 
image processing of the image data which picturized the measuring object object installed in the 
world coordinate with two or more of these image pick-up equipments 1 and 2, and it asks for 
the location in the monitor system of coordinates in the image pick-up equipment of point of 
measurement 7. In the three-dimension location metering device by the stereo method which 
measures the location in the world coordinate of point of measurement 7 based on this monitor 
coordinate location The calibration plate 9 with which two or more pattern 9a was drawn on the 
predetermined location in a world coordinate predetermined distance every beforehand When 
installed in two or more estranged locations, The image data which picturized the calibration 
plate 9 with said two or more image pick-up equipments 1 and 2 is inputted for every location, 
this calibration plate 9 — each — alienation — This coordinate value of two or more points in 
monitor system of coordinates is computed from the location of two or more points 
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corresponding to each above-mentioned pattern 9a on this image. It asks for the curved-surface 
polynomial which approximates the curved surface 1 1 formed of two or more points in the 
monitor system of coordinates corresponding to the calibration plate 9 in a location describing 
above based on said computed coordinate value, said — each — alienation — Each multiplier of 
the curved-surface polynomial corresponding to a location is memorized, each — alienation — 
after this at the time of location measurement of an actual measuring object object The 
coordinate value of the point of measurement 7 in monitor system of coordinates is computed 
from the location of the point of measurement 7 on an image. This computed coordinate value. It 
is considering as the configuration equipped with the image processing system 5 which computes 
and measures the location of the world coordinate of point of measurement 7 with interpolation 
based on physical relationship with the curved surface 11 of the both sides which faced across 
the point of measurement 7 in monitor system of coordinates among two or more curved 
surfaces 1 1 depended on each multiplier of two or more curved-surface polynomials by which 
storage was carried out [ above-mentioned ]. 

[0009] Invention according to claim 7 with two or more image pick-up equipments 1 and 2 which 
installed the optical axis of a lens in the mutually different direction Picturrze the measuring 
object object installed in the world coordinate, carry out the image processing of this picturized 
image data, and it asks for the location in the monitor system of coordinates in the image pick- 
up equipment of point of measurement 7. In the three-dimension location measurement approach 
by the stereo method which measures the location in the world coordinate of point of 
measurement 7 based on this monitor coordinate location The calibration plate 9 with which two 
or more pattern 9a was drawn on the predetermined location in a world coordinate 
predetermined distance every beforehand When installed in two or more estranged locations, The 
image data which picturized the calibration plate 9 with said two or more image pick-up 
equipments 1 and 2 is inputted for every location, this calibration plate 9 — each — alienation - 

- This coordinate value of two or more points in monitor system of coordinates is computed 
from the location of two or more points corresponding to each above-mentioned pattern 9a on 
this image. It asks for the curved-surface polynomial which approximates the curved surface 1 1 
formed of two or more points in the monitor system of coordinates corresponding to the 
calibration plate 9 in a location describing above based on said computed coordinate value, said 

— each — alienation — Each multiplier of the curved-surface polynomial corresponding to a 
location is memorized, each — alienation — after this at the time of location measurement of an 
actual measuring object object The coordinate value of the point of measurement 7 in monitor 
system of coordinates is computed from the location of the point of measurement 7 on an image. 
This computed coordinate value, It is considering as the approach of computing and measuring 
the location of the world coordinate of point of measurement 7 with interpolation based on 
physical relationship with the curved surface 1 1 of the both sides which faced across the point 
of measurement 7 in monitor system of coordinates among two or more curved surfaces 1 1 
depended on each multiplier of two or more curved-surface polynomials by which storage was 
carried out [ above-mentioned ]. 

[0010] According to invention according to claim 1 or 7, carry out the image processing of the 
image data which picturized the measuring object object with two or more image pick-up 
equipments which installed the optical axis of a lens in the mutually different direction, and the 
monitor coordinate of point of measurement is acquired, but If a calibration plate is installed in 
two or more locations estranged predetermined distance every and is picturized, the curved 
surface which corresponds for every installation location of a calibration plate will be acquired by 
two or more points within the monitor coordinate corresponding to two or more patterns in a 
calibration plate. Each curved surface and the set of the multiplier of each curved-surface 
polynomial can be made to correspond uniquely by approximating each of this curved surface by 
the predetermined curved-surface polynomial, respectively. Therefore, beforehand, the set of 
this multiplier is made to correspond to each installation location of a calibration plate, and is 
memorized, and the location of the world coordinate of point of measurement is computed by 
interpolation based on physical relationship with the curved surface of the both sides which 
faced across the point of measurement in monitor system of coordinates among the coordinate 
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value in the monitor system of coordinates corresponding to point of measurement, and two or 
more curved surfaces depended on each multiplier of two or more memorized curved-surface 
polynomials at the time of location measurement of actual point of measurement. Consequently, 
since it can be made to compress without [ direction ] informational degradation [ amount of 
data / calibration data storage ] compared with the approach of memorizing correspondence of 
the coordinate in the world coordinate and monitor system of coordinates of each pattern for 
every installation location of a calibration plate memorizing each above-mentioned multiplier, 
reduction of memory space and shortening of the operation time are attained. 
[001 1] The curved-surface polynomial to which invention according to claim 2 approximates said 
curved surface 1 1 in the three-dimension location metering device by the stereo method 
according to claim 1 is characterized by being a smooth three-dimension polynomial. 
[0012] Invention according to claim 8 makes the curved-surface polynomial which approximates 
said curved surface 1 1 the smooth three-dimension polynomial in the three-dimension location 
measurement approach by the stereo method according to claim 7. 

[0013] [0014] which stores an approximation error within predetermined tolerance and can 
approximate it with a sufficient precision since the curved surface is approximated by the three- 
dimension polynomial according to invention according to claim 2 or 8 In the three-dimension 
location metering device according [ invention according to claim 3 ] to the stereo method 
according to claim 1 One axis of coordinates of a world coordinate is set as the lens optical axis 
of the 1st image pick-up equipment 1 at least at parallel among said two or more image pick-up 
equipments 1 and 2. The lens optical axis of the 2nd image pick-up equipment 2 is made to 
incline to a top Norikazu axis of coordinates. And said image processing system 5 Based on the 
image data of the image pick-up equipment 1 of the above 1st, he computes the coordinate 
value by the axis of coordinates of the monitor system of coordinates which intersect 
perpendicularly with the one above-mentioned axis of coordinates, and is trying to compute the 
coordinate value by the axis of coordinates of monitor system of coordinates parallel to the one 
above-mentioned axis of coordinates based on the image data of the image pick— up equipment 2 
of the above 2nd. 

[0015] In the three-dimension location measurement approach according [ invention according 
to claim 9 ] to the stereo method according to claim .7 Among said two or more image pick-up 
equipments 1 and 2, at least, while setting one axis of coordinates of a world coordinate as the 
lens optical axis of the 1st image pick-up equipment 1 at parallel and making the lens optical axis 
of the 2nd image pick— up equipment 2 incline to a top Norikazu axis of coordinates It is 
considering as the approach of computing the coordinate value by the axis of coordinates of the 
monitor system of coordinates which intersect perpendicularly with the one above-mentioned 
axis of coordinates based on the image data of the image pick— up equipment 1 of the above 1st, 
and computing the coordinate value by the axis of coordinates of monitor system of coordinates 
parallel to the one above-mentioned axis of coordinates based on the image data of the image 
pick-up equipment 2 of the above 2nd. 

[0016] According to invention according to claim 3 or 9, the image in the 1st image pick-up 
equipment expresses the flat surface which intersects perpendicularly with one axis of 
coordinates of a world coordinate, and, therefore, the coordinate value of the monitor system of 
coordinates called for from this image data will express the coordinate value of other two axes of 
coordinates which intersect perpendicularly with a world coordinate top Norikazu axis of 
coordinates itself. Moreover, since one axis of coordinates of the monitor system of coordinates 
by the image in the 2nd image pick-up equipment becomes parallel to a world coordinate top 
Norikazu axis of coordinates, it can compute the coordinate value in a world coordinate top 
Norikazu axis of coordinates easily with the coordinate value in a monitor system-of-coordinates 
top Norikazu axis of coordinates. Therefore, since each coordinate value in a world coordinate is 
easily computable, the load of data processing is mitigable. 

[0017] Said calibration plate 9 with which invention according to claim 4 is installed in said two 
or more locations in the three-dimension location metering device by the stereo method 
according to claim 1 is [0018] characterized by intersecting perpendicularly with one axis of 
coordinates of a world coordinate. In the three-dimension location measurement approach by the 
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stereo method according to claim 7, invention according to claim 10 is taken as the approach of 
making intersect perpendicularly with one axis of coordinates of a world coordinate, and 
installing, when installing said calibration plate 9 in two or more locations. 

[0019] Since according to invention according to claim 4 or 10 one axis of coordinates of a world 
coordinate and a calibration plate are made to cross at right angles and is installed, when 
calculating the coordinate value in the world coordinate top Norikazu axis of coordinates of point 
of measurement based on this calibration data, it can calculate with interpolation etc. very easily. 
Therefore, the load of data processing is mitigable. 

[0020] In the three-dimension location metering device according [ invention according to claim 
5 ] to the stereo method according to claim 2 or 3 When said image processing system 5 
computes the location of the world coordinate of the point of measurement 7 of said measuring 
object object based on each curved-surface polynomial in the monitor system of coordinates 
approximated corresponding to said two or more curved surfaces 11, each above-mentioned 
curved-surface polynomial, He is trying to compute the location of the world coordinate of point 
of measurement 7 by calculating the coordinate value of the intersection of said curved surface 
11 and this straight line, and interpolating the coordinate value of this intersection based on the 
formula which expresses a straight line parallel to a passage and one axis of coordinates in 
monitor system of coordinates for the point of measurement 7 in monitor system of coordinates. 

[0021] In the three-dimension location measurement approach according [ invention according 
to claim 1 1 ] to the stereo method according to claim 8 or 9 When computing the location of the 
world coordinate of the point of measurement 7 of said measuring object object based on each 
curved-surface polynomial in the monitor system of coordinates approximated corresponding to 
said two or more curved surfaces 1 1 Each above-mentioned curved-surface polynomial and the 
point of measurement 7 in monitor system of coordinates are based on the formula showing a 
straight line parallel to a passage and one axis of coordinates in monitor system of coordinates. 
The coordinate value of the intersection of said curved surface 11 and this straight line is 
calculated, and it is considering as the approach of computing the location of the world 
coordinate of point of measurement 7 by interpolating between the coordinate values of this 
intersection. 

[0022] When computing the location of the world coordinate of point of measurement according 
to invention according to claim 5 or 1 1 The curved-surface polynomial expressed with the 
multiplier memorized as calibration data, Based on the formula showing a straight line parallel to 
a passage and one axis of coordinates in monitor system of coordinates, the coordinate value of 
the intersection of said curved surface and said straight line is calculated by easy count in the 
point of measurement in monitor system of coordinates, and the location of the world coordinate 
of point of measurement is computed by interpolating between the coordinate values of this 
intersection. Therefore, the load of data processing is mitigable. 

[0023] Invention according to claim 6 is characterized by at least one of said two or more image 
pick-up equipments 1 and 2 being slanting CCD camera equipment in the three-dimension 
location metering device by the stereo method according to claim 1 to 5. 

[0024] Since slanting CCD camera equipment is used according to invention according to claim 
6 r the depth of the image data of a measuring object object is picturized deeply. Therefore, since 
it can compute with a sufficient precision when computing the coordinate in monitor system of 
coordinates by carrying out the image processing of the image data, the precision of location 
measurement can be improved. 
[0025] 

[Embodiment of the Invention] Hereafter, an operation gestalt is explained with reference to a 
drawing. Drawin g 1 shows the configuration of the three-dimension location metering device by 
the stereo method concerning this invention. First, the predetermined axes of coordinates X. Y, 
and 2 which intersect perpendicularly mutually [ a world coordinate ] are established in the 
space in which the measuring object object 8 is installed, and it considers measuring the 
coordinate location in the world coordinate of the point of measurement 7 of the measuring 
object object 8 with this three-dimension location metering device. In order to measure by the 
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stereo method, it has two sets (it is henceforth called a monitoring device) of two sets of the 
image pick-up equipments 1 and 2, and the image display devices 3 and 4 corresponding to this, 
and an image processing system 5 here. The lens optical axis of the 1st image pick-up 
equipment 1 is installed in parallel with the direction of one axis of coordinates (here Z-axis) of a 
world coordinate, and the lens optical axis of the 2nd image pick-up equipment 2 is installed so 
that a predetermined include angle may be accomplished to the direction of a top Norikazu axis 
of coordinates (here Z-axis). In addition, the 2nd image pick-up equipment 2 is good also as 
slanting CCD equipment which set up that image pick-up side aslant to this lens optical axis. 
[0026] The image processing of the image pick-up signal from each image pick-up equipments 1 
and 2 is carried out with an image processing system 5. and each image is displayed on 
monitoring devices 3 and 4. The axis of coordinates on the image which sets to P and Q now the 
axis of coordinates on the image displayed by the monitoring device 3. and is displayed by the 
monitoring device 4 is set to R and S. At this time, axes of coordinates P and Q are the axes of 
coordinates showing a field parallel to the flat surface (X-Y flat surface) which intersects 
perpendicularly with one axis of coordinates (here Z-axis) of a world coordinate parallel to the 
lens optical axis of the 1st image pick-up equipment 1. Moreover, either of the axes of 
coordinates R and S (here R shaft) is set up so that it may become parallel to a world coordinate 
top Norikazu axis of coordinates (here Z-axis). 

[0027] While an image processing system 5 inputs and carries out the image processing of the 
image pick-up signal of point of measurement 7 from the image pick-up equipments 1 and 2 and 
outputting each image to monitoring devices 3 and 4, respectively, based on the coordinate 
location by the axes of coordinates P and Q of point of measurement 7. and the coordinate 
location by axes of coordinates R and S, the coordinate location in the world coordinate of point 
of measurement 7 is calculated. This image processing system 5 makes computer apparatus, 
such as the usual microcomputer, a subject, and is constituted. Moreover, the memory which 
memorizes beforehand calibration data required for an image processing system 5 for location 
measurement before measurement is prepared. 

[0028] Next, the contents of processing of an image processing system 5 are explained 
according to the procedure. In the three-dimension location metering device by the stereo 
method concerning this invention, two or more points that the coordinate location in a world 
coordinate is specified are beforehand picturized, respectively with the 1st and 2nd image pick- 
up equipment 1 and 2, and the data (this is called calibration data) showing the correspondence 
relation between the coordinate location in this world coordinate, the coordinate location by axes 
of coordinates P and Q, and the coordinate location by axes of coordinates R and S are 
memorized. And at the time of location measurement of the actual point of measurement 7, a 
interpolation operation is carried out based on the coordinate location and the above-mentioned 
calibration data of the point corresponding to the point of measurement 7 on an image t and it is 
asking for the coordinate location of the point of measurement 7 in a world coordinate. 
[0029] First, the creation approach of calibration data is explained based on drawing 2 - drawing 
5 . In drawing 2 , as for the calibration plate 9, two or more pattern 9a as which mutual physical 
relationship (a location or distance, and direction) was specified is drawn on an even 
predetermined base, A circular graphic form with black predetermined magnitude is drawn by this 
pattern 9a with means, such as sensitization, and plating, etching, on an opaque substrate just 
possible [ distinction with the image pick-up equipments 1 and 2 ]. In this drawing, two or more 
black circular graphic forms are drawn on the predetermined location at intervals of 
predetermined. And this calibration plate 9 is installed at right angles to one axis of coordinates 
(Z-axis) parallel to the lens optical axis of the 1st image pick-up equipment 1 of a world 
coordinate. The calibration plate 9 is picturized with the 1st and 2nd image pick-up equipment 1 
and 2, with an image processing system 5, the image processing of each pattern 9a is performed, 
and the coordinate location data based on the axes of coordinates P and Q of each pattern 9a 
and the coordinate location data based on axes of coordinates R and S are computed, 
respectively. Furthermore, as shown in drawing 3 , the location of Z shaft orientations of the 
calibration plate 9 is shifted at intervals of predetermined distance, the calibration plate 9 is 
picturized by two or more of these places, and the coordinate location data based on the above- 
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mentioned axes of coordinates P and Q and axes of coordinates R and S of each pattern 9a 
corresponding to a Z shaft each location are computed, respectively. In addition, the above- 
mentioned predetermined distance spacing may be fixed spacing, or may be spacing which makes 
spacing small depending on a location to measure with a sufficient precision, and is different, 
respectively. 

[0030] Here, as mentioned above, since axes of coordinates P and Q and axes of coordinates X 
and Y are parallel, it can ask for the coordinate location data based on axes of coordinates X and 
Y by easy transformation from the coordinate location data based on axes of coordinates P and 
Q. Moreover, since the axis of coordinates R is parallel to an axis of coordinates Z among axes 
of coordinates R and S t many coordinate location data based on an axis of coordinates R will be 
included with the positional information by the axis of coordinates Z. Therefore, the coordinate 
location in a world coordinate is computed from this monitor system of coordinates, a call, and 
henceforth using coordinate location data according the space stretched with axes of 
coordinates P, Q, and R to these monitor system of coordinates. 

[0031] Two or more points in the monitor system of coordinates corresponding to two or more 
pattern 9a on the above-mentioned calibration plate 9 form a flat surface or a curved surface 1 1 
(on account of explanation, henceforth, it unifies and is called a curved surface 1 1) 
predetermined by monitor system of coordinates, as shown in drawi ng 4 . Generally, the field in 
these monitor system of coordinates turns into a curved surface. Therefore, corresponding to 
two or more above-mentioned calibration plates 9, as shown in drawing 5 , two or more curved 
surfaces 1 1 are formed. Since the continuity is maintained, each of this acquired curved surface 
1 1 can approximate each curved surface 1 1 by predetermined curved-surface polynomials, such 
as for example, a two-dimensional polynomial, using a certain approximation technique. If a two- 
dimensional polynomial is expressed with a formula "R=a1, P2+a2, Q2+a3, PQ+a4, P+a5, and 
Q+a6", one curved surface 1 1 can be made to correspond uniquely with the set of these 
multipliers a1— a6 here. Therefore, instead of memorizing the position-coordinate data of each 
pattern 9a for two or more above-mentioned curved surfaces 1 1 of every, by memorizing each 
set of the multipliers a1-a6 corresponding to each curved surface 11 as calibration data, the 
amount of data, to memorize can be compressed without informational degradation, and memory 
space can be decreased. 

[0032] Next, how to compute the position coordinate in the world coordinate of point of 
measurement 7 based on calibration data at the time of actual location measurement is 
explained with reference to drawin g 6 - draw ing 9 . As a result of picturizing point of 
measurement 7 with two image pick-up equipments now, suppose that the position coordinate 
(pO, q0, and rO) in the monitor system of coordinates of point of measurement 7 was searched 
for as shown in drawing 6 . By this position coordinate (pO and q0), it can ask for the coordinate 
location data based on the axes of coordinates X and Y of a world coordinate using easy 
transformation. Moreover, coordinate value rO It is based, and as it is the following, the 
coordinate location data based on an axis of coordinates Z are called for. 

[0033] That is, first, as shown in drawin g 7 ; R shaft position coordinate of the intersection of 
the straight line expressed with a formula "p=p0 and q=q0" and two or more curved surfaces 1 1 
corresponding to said each set of the multipliers a1-a6 of calibration data memorized beforehand 
is computed. And two R shaft position coordinates (here, referred to as r1 and r2) are elected as 
order with a near distance of the point of said position coordinate (pO, q0, and rO), and each 
intersection among R shaft position coordinates of each of this computed intersection like 
drawing 8 . These two R shaft position coordinates express R shaft position coordinate of the 
intersection in the interior of the curved surface 1 1 of the both sides which have sandwiched the 
point of said position coordinate (pO, qO, and rO) in between, next, the formula 1 — the above- 
mentioned position coordinate rO The two above-mentioned R shaft position coordinates r1 and 
r2 the ratio of the absolute value of a difference — it asks for H. 

[Equation 1] Since the distance between the H=|r curved surfaces 1 1 which carry out 1~r0 |:|r2- 
rO |=m:n contiguity is small, the above-mentioned ratio H becomes an almost equal value in a 
world coordinate, therefore, Z-axis coordinate location data [ in / as shown in drawing 9 / the 
world coordinate of point of measurement 7 ] — the above-mentioned R shaft position 
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coordinate rl and r2 the ratio of the above [ between the Z-axis coordinate values of two 
calibration plates 9 which correspond, respectively ] — it can divide and ask by H. 
[0034] As explained above, before carrying out location measurement, the plane calibration plate 
9 with which two or more patterns with which mutual physical relationship was specified for the 
calibration were drawn is picturized with two Image pick-up equipments 1 and 2, and it asks for 
the coordinate location in the monitor system of coordinates corresponding to each pattern by 
the image processing. It arranges so that it may become parallel [ the lens optical axis of the 1st 
image pick-up equipment 1 ] to one axis of coordinates (here Z-axis) of a world coordinate 
between two image pick-up equipments 1 and 2. and the lens optical axis of the 2nd image pick- 
up equipment 2 is leaned and arranged so much in this one axis of coordinates at the 
predetermined include angle. Therefore, since the axes of coordinates P and Q changed by the 
image pick-up data of the 1st image pick-up equipment 1 become parallel to the flat surface 
which intersects perpendicularly with a world coordinate top Norikazu axis of coordinates, it can 
ask for the coordinate location by other two axes of coordinates of the world coordinate of point 
of measurement 7 easily. Moreover, many information of the axes of coordinates R and S 
changed by the image pick-up data of the 2nd image pick-up equipment 1, on the other hand 
(here R shaft), concerning a world coordinate top Norikazu axis of coordinates will be included. 
Axes of coordinates P, Q, and R constitute monitor system of coordinates from this, and the 
location of a world coordinate is measured from the coordinate value of the point of 
measurement 7 in these monitor system of coordinates. 

[0035] The above-mentioned calibration plate 9 is picturized in two or more locations which it 
was installed at right angles to a top Norikazu axis of coordinates, and were shifted for every 
predetermined distance. And it is formed corresponding to two or more of these locations, 
without two or more curved surfaces 1 1 crossing mutually by the set of the point of each 
pattern in monitor system of coordinates. Since each of this curved surface 11 is approximated 
by the predetermined polynomial (for example, two-dimensional polynomial) showing a curved 
surface, the set of each multipliers a1-a6 of the polynomial at this time can express the curved 
surface 1 1 which corresponds uniquely. Therefore, by making it correspond to two or more 
curved surfaces 11, and memorizing the set of these multipliers a1-a6 as calibration data, it 
becomes compressible [ stored data ] and the data-processing time amount based on calibration 
data can be shortened. 

[0036] At the time of actual location measurement, the position coordinate in a world coordinate 
is computed based on the position coordinate (pO, qO t and rO) and the above— mentioned 
calibration data in monitor system of coordinates of point of measurement 7. That is, the 
position coordinate (XO and Y0) of a world coordinate is easily searched for from a position 
coordinate (pO and qO). Moreover, R shaft position coordinate of the intersection of the straight 
line expressed with a formula "p=p0 and q=q0" and two or more curved surfaces 1 1 
corresponding to each set of multipliers a1-a6 is computed. R shaft position coordinate r1 of an 
intersection with two curved surfaces 11 nearest to the point of a position coordinate (pO, qO, 
and rO) and r2 electing — said formula 1 — position coordinate rO Two R shaft position 
coordinates r1 and r2 the ratio of the absolute value of a difference — it asks for H. [ among 
these, ] this R shaft position coordinate r1 and r2 the ratio of the above [ between two 
corresponding Z-axis coordinate values of a curved surface 11] — dividing by H — position 
coordinate Z0 in the world coordinate of point of measurement 7 It asks. [ and ] Therefore, 
three-dimension location measurement can be performed with high precision and simply, without 
measuring the physical relationship between two image pick-up equipments 1 and 2. 
[0037] Moreover, the position-coordinate data in the monitor system of coordinates called for by 
carrying out the image processing of two or more points on the image when picturizing two or 
more pattern 9a on the same calibration plate include the operation error at the time of an image 
processing etc. in itself. Therefore, when it is used directly, having used this position-coordinate 
data as calibration data and the location of a world coordinate is calculated with interpolation, it 
becomes easy to be influenced of the above-mentioned error, and precision may be spoiled. 
Since approximation interpolation of the set of two or more points on monitor system of 
coordinates describing above is carried out as mentioned above on a curved surface according 
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to this invention, the above-mentioned error is amended and, therefore, highly precise 
measurement is attained. 

[0038] In addition, since the curved surface formed of the set of two or more points on monitor 
system of coordinates describing above turns into a secondary curved surface theoretically, if it 
says strictly, this curved surface must be approximated on a secondary curved surface. 
However, this invention may be approximated on still higher order multi-dimension curved 
surfaces, such as the 3rd curved surface, for example, as long as it does not limit to a secondary 
curved surface and approximation is settled in a predetermined approximation error. Even when 
the configuration of an actual metering device differs from the theory greatly by a certain cause 
and cannot approximate by this on a secondary curved surface, it becomes possible to 
approximate according to a predetermined multi-dimension curved surface. Furthermore, if it 
says, as long as approximation will be settled in a predetermined approximation error, you may 
approximate using what kind of curved-surface type. 

[0039] Moreover, the software incorporating the measurement approach described above uses a 
floppy disk as the electronic data-logging medium which stores this software, and circulation 
distribution is carried out. This electronic data-logging medium may not be restricted to a floppy 
disk, and a hard disk, an IC card, or CDROM is sufficient as it. Moreover, the gestalt of 
circulation distribution may also take the gestalt which connects via a public line or a network, 
the hardware not only using circulation by the electronic data-logging medium but said software, 
and the development device by which the above-mentioned software is contained, for example, 
the personal computer for development, and carries out circulation distribution. In the case of 
said circulation distribution, the installer for installing in the hardware using said software, for 
example, the test equipment of dedication, the equipment which connected the personal 
computer and the electronic camera is attached, circulation distribution may be carried out and 
circulation distribution of the data which carried out capacity compression of the software 
incorporating said measurement approach may be carried out. 
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DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing t] The configuration of the three-dimension location metering device concerning this 
invention is shown. 

[Drawing J2"l It is the explanatory view of the calibration plate concerning this invention. 
[Draw ing 3] It is the explanatory view of the installation location of the calibration plate 
concerning this invention. 

[Drawin g 4] It is the explanatory view of the curved surface in the monitor system of coordinates 
corresponding to the calibration plate concerning this invention. 

[Drawing 5] It is the explanatory view of two or more curved surfaces in the monitor system of 
coordinates corresponding to two or more locations of the calibration plate concerning this 
invention. 
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[Drawing 6] It is the explanatory view of the location in the monitor system of coordinates of the 
point of measurement concerning this invention. 

[Drawing 7] It is the calculation approach explanatory view of R shaft position coordinate in the 
monitor system of coordinates of the point of measurement concerning this invention. 
[Drawing 8 ] It is the calculation approach explanatory view of R shaft position coordinate in the 
monitor system of coordinates of the point of measurement concerning this invention. 
[Drawi n g 9 ] It is the calculation approach explanatory view of the Z-axis position coordinate in 
the world coordinate of the point of measurement concerning this invention. 
[Description of Notations] 

1 1st Image Pick-up Equipment 

2 2nd Image Pick-up Equipment 

3 Four Monitoring device 

5 Image Processing System 

7 Point of Measurement 

8 Measuring Object Object 

9 Calibration Plate 
9a Pattern 

1 1 Curved Surface 

X, Y, Z World coordinate shaft 

P, Q, R. S Monitor axis of coordinates 
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DRAWINGS 



[Drawing 1] 




[ Drawing 2] 
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[Drawing 3] 



[Dra win g 4] 

R 




[Drawing 5] 

R 




[Drawing 6] 
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